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In this note we explain the use of the cavity method directly at zero temperature, 
in the case of the spin glass on a lattice with a local tree like structure, which is the 
proper generalization of the usual Bethe lattice to frustrated problems. The computation 
is done explicitly in the formalism equivalent to 'one step replica symmetry breaking'; we 
compute the energy of the global ground state, as well as the complexity of equilibrium 
states at a given energy. Full results are presented for a Bethe lattice with connectivity 
equal to three. The main assumptions underlying the one step cavity approach, namely 
the existence of many local ground states, are explicitely stated and discussed: some of 
the main obstacles towards a rigorous study of the problem with the cavity method are 
outlined. 
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I. INTRODUCTION 



G 

The cavity method, initially invented to deal with the Sherrington Kirkpatrick model of spin glasses 
[1,2], is a powerful method to compute the properties of ground states in many condensed matter and 
optimization problems. It was originally developed at finite temperature, but if one is mainly interested 
£N| , in the optimization problem concerning the structure of ground states, it turns out to be easier to apply 
^ ■ it directly at zero temperature, where many of the concepts can be explained in a more straightforward 
way. The aim of this note is to discuss the use of the cavity method at zero temperature. In order to be 
definite, we will study the concrete case of a spin glass on the Bethe lattice (the precise definition of the 
Bethe lattice which we use for spin glasses is given in sect. II), although the scope of application of the 
method is much wider; indeed the best applications of the formalism we present here are those dealing 
£»o ' with optimization problems [3] , like for instance the K-satisfiability problem [4] or some of its variants [5] . 

The cavity method is in principle equivalent to the replica method, but it turns out to have a much 
clearer and more direct interpretation, that allows in practice to find solutions to some problems which 
remain rather difficult to understand in the replica formalism: the replica approach is very elegant and 
compact, but it is more difficult to get an intuitive feeling of what is going on. Also, the cavity approach 
deals with usual probabilistic objects, and can lend itself to rigorous studies [7,8]. We shall present it here 
at two successive levels of approximation. The first one, corresponding in replica language to the replica 
symmetric (RS) solution, is an easy one and has already been studied a lot. The main aim of the paper 
£j , is to explain in some details how one can solve the problems at the level of a 'one step replica symmetry 
breaking' (1RSB). For years, this was only possible for systems with infinite range interactions. We have 
recently found a general procedure allowing to get this 1RSB solution for problems defined on the Bethe 
lattice [9], and here we explain in some details its use directly at zero temperature. We shall give an 
explicit example of this 1RSB solution for the Bethe lattice spin glass with connectivity equal to three. 

The paper is organised as follows: in sect. II we introduce the Bethe lattice spin glass, the basic ideas 
of iterative techniques, and the main questions which one wants to answer. Sect. Ill presents the cavity 
method when one assumes that there is only one local ground state (the RS approximation). The 1RSB 



1 



solution is described in sect. IV. The paper ends with some remarks (sect. V), and is complemented 
by two appendices: Appendix A shows how the present zero temperature work is connected to the limit 
T — > of finite temperature analyses, and how this can be used to estimate the validity of a given level of 
RSB. Appendix B explains how the cavity equations can be interpreted from a variational point of view. 
Appendix C contains some miscellaneous comments on the definition of the local ground states. 



II. GENERALITIES 



We consider an Ising spin glass model on a special class of random lattices which we call Bethe lattice. 
This is defined here as as a random lattice with fixed connectivity k + 1. Such graphs locally look like 
a portion of a Cayley tree, but they display loops at large distances (of length of order log(N)/ log(fc), 
where N is the number of points in the lattice). In unfrustrated problems, the Bethe lattice is defined as 
the interior of a large Cayley tree, but this definition is not appropriate for frustrated systems like spin 
glasses, where the presence of loops is essential to insure the existence of frustration. It has been argued 
in [9] that the natural generalization of the Bethe lattice to frustrated systems is provided by the random 
lattices with fixed connectivity which we study here. Notice that in these systems, the frustration and 
the disorder are due to the presence of loops, and thus occur only on large scales. Locally, the structure 
around almost all point is tree-like. 

Spins are located at the vertices of the graph, and interact with neighbouring spins with exchange 
couplings. In the spin glass case the Hamiltonian is defined as: 

h = - Ji 3 <7i(jj . (i) 

<ij> 

The sum is over all links of the lattice (there are k + 1 links incoming onto each site i). For each link 
< ij > the coupling is an independent random variable chosen with the same probability distribution 
P(J). 

One of our aims is to compute, in the infinite N limit, the value of the energy density of the global 
ground state (GGS), which is the configuration of Ising spins Oi = ±1 which minimizes the Hamiltonian. 
More precisely the ground state energy of a N spin system, averaged over the distribution of samples (i.e. 
both over the choices of random graphs, and the values of the couplings) will be denoted by En- We want 
to compute 

U = lim ^ . (2) 

We are also interested in computing, in the same limit, the number of local ground states (LGS) with 
a given energy, where a LGS is defined as a configuration whose energy cannot be decreased by flipping 
a finite number of spins (when N — > oo). 

The basic locally tree-like structure is best exploited by an iterative method that has been called, in 
the context of spin glasses, the cavity method. Let us introduce an intermediate object which is a spin 
glass model with N spins, on a slightly different random lattice, where q randomly chosen 'cavity' spins 
have only k neighbours, while the other N — q spins all have k + 1 neighbours (see fig.l). We call such 
a graph a GN, q 'cavity graph'. The cavity spins are fixed, their values are <7i, a q . The GGS energy of 
the corresponding spin glass model obviously depends on the values of the cavity spins. 
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FIG. 1. An example, for the case k = 2, of a Qn,6 cavity graph where q = 6 randomly chosen cavity spins have 
2 neighbours only. All the other N — 6 spins outside the cavity are connected through a random graph such that 
every spin has k + 1 = 3 neighbours. 

While our primary interest is in the ground state configurations on Gn,o graphs, the intermediate 
construction of GN,q is helpful. The basic operations which one can perform on cavity graphs are the 
following: 

• Iteration: By adding a new spin a of fixed value into the cavity, connecting it to k of the cavity 
spins say a\, a^, and optimizing the values of these k spins, one changes a GN,q into a (/jv+i.g-fc+i 
graph: 

5N = 1, 5q = -k + l. (3) 

• Link addition: By adding a new link between two randomly chosen cavity spins a\ , 02 , and optimizing 
the values of these 2 spins one changes a §N, q into a GN,q-2 graph: 

SN = 0, 5q = -2 . (4) 

• Site addition: By adding a new spin er into the cavity, connecting it to k + 1 of the cavity spins 
say 01, C7fc+i, and optimizing the values of the k + 2 spins a\, (Tfe+2, one changes a Qn,q into a 
0jv+i, 9 -fc-i graph: 

5N = 1, 5q = -k-l. (5) 

In particular, if one starts from a <?Ar.2(fc+i) cavity graph and perform k + 1 link additions, one gets a 
£?/v,o graph, i.e. our original spin glass problem with N spins. Starting from the same £?jv,2(fc+i) cavity 
graph and performing 2 site additions, one gets a Gn+2,o graph, i.e. our original spin glass problem with 
N + 2 spins. Therefore the variation in the GGS energy when going from N to N + 2 sites — Ejy) 

is related to the average energy shifts AE^ for a site addition, and AE^ for a link addition, through: 

E N+2 -E N = 2AE^ - (k + l)AE (2 *> . (6) 

Using the fact that the total energy is asymptotically linear in N, the energy density of the ground state 
is finally 

U = lim E N /N = En +*- En = A£(D - ttl AE (2) (7) 

N^oc 2 2 
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FIG. 2. Starting from the Qn,6 cavity graph, one can either add two sites (left figure) and create a Gn+2,o graph, 
or add three links (right figure) and create a Gn,o graph. 

An intuitive interpretation of this result (for even k + 1) is that in order to go from N to N + 1 one 
should remove (k + l)/2 links (the energy for removing a link is minus the energy for adding a link) and 
then add a site. There are several alternative derivations and expressions of this energy density [10], but 
the previous one is the simplest one for our purpose. 



When q/N <C 1, generically, the distance on the lattice between two generic cavity spins is large (it 
diverges logarithmically in the large N limit). It is thus reasonable to assume that the various cavity 
spins become uncorrelated. This is the basic assumption of the RS solution, although it is in general 
not explicitly formulated. Several papers have worked out this RS solution in details at all temperatures 
[11-19]. Here we are presenting for completeness the zero temperature version of this RS approach, the 
modifications induced in the 1RSB case will be explained below. This RS assumption amounts to saying 
that the GGS energy of a QN,q spin glass can be written as an additive function of the values of the q 
cavity spins: 



The quantities hi, that we call the local cavity fields, depend on the sample. When considering the 
ensemble of random cavity graphs, they are independent identically distributed (iid) random variables, 
and their distribution is denoted V(h). The computation of V(h) will be a crucial step in our approach. 
The reader should notice that in general there is no simple expression for the local cavity fields of the type: 
hi = JikCk '■ These fields are related to the difference in energy of two GGS with flipped cavity spins, 
and these two GGS may in principle differ in an arbitrarily large number of spins. Indeed the quantity 
E({a}) is computed by minimizing the energy as function of the other N — q spins for fixed values of the 
q cavity spins. 



III. "REPLICA SYMMETRIC" SOLUTION 



A. General case 




(8) 
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FIG. 3. In the iteration procedure, one adds a new spin into the cavity, and connects it to k randomly chosen 
cavity spins, with some randomly chosen couplings. Here an example with k — 2. 



The key hypothesis of the RS treatment is that the GGS of the spin glass before and after any of 
the previous graph operations (e.g. iteration) are related. Equivalently one should assume that the 
perturbation corresponding to the variation of one of the cavity spins remains localized and it does not 
propagate to the whole lattice. Under this hypothesis (whose consistency can be checked and, as we shall 
see later, is not always correct) a self consistent equation for this distribution is easily found by considering 
the iteration procedure (see fig. 3). We add a new spin in the cavity, fix its value to (Jq, and connect it to 
the spins a\, ...,<7fc through a new set of coupling constants Ji, Jfc. Each of the spins <7j, i G {1, k}, 
sees a local magnetic field hi + Ji<7oi an d nas to point into the direction of this field in order to minimize 
its energy (if the local field is zero this spin is free to point in any direction). The energy of the link 
between a® and Oi is thus: 

ei = min(-^ - JjCTo)^ = -\hi + Ji<r \ = -a(J. h h t ) - a u{J^hi) , (9) 
where an elementary computation gives: 

u{J u hi) = \{\hi + Ji\-\hi-Ji\) , a{J i ,h i ) = ^{\h i + J i \ + \h i -J i \) = \h i \ + \J i \-\u{J i M)\- (10) 

This shows in particular that the new local field on site 0, i.e. the coefficient of Co in the expression for 
the GGS energy, is given by [20]: 

k 

hg = y~* J u (Jn hi) . (11) 

i=l 

This implies a recursion relation for the distribution V(h): 



V{h) = Ej 



' k f k ^ 

J 1] [ dh iHhi]\ S f h - <Jh hi) 



(12) 



(Throughout this paper, we use a generic notation Ej[-\ to indicate the average over the distribution of 
all coupling constants and over random graphs). 

Let us suppose that the previous equation is sufficient to determine the distribution V(h). If we know 
this distribution we can compute the energy. The average energy shift due to a site addition is 
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AE^ = -Ei 



/fc+1 /fc+1 fc+1 

1] [dhiVihi)} J2 < J ^ h i) + I E < J i> h i)\ 

i=l \j=l j=l 



(13) 



and the average energy shift due to a link addition is 

2 



AE^ = -Ej 



/ TT [dh{P{hi)] max {h\Gi + h 2 a 2 + J01CT2) 

I - LJ - <Tl ,(72 

i=l 



(14) 



These expressions give the ground state energy density through (7). 



B. Application to the ±J model 

In order to obtain the RS solution, one must first solve the functional equation (12) for V(h). This is 
particularly easy in the case where the couplings are taken from the distribution P(J) = (1/2)(<5(J — 1) + 
S(J + 1)). The definition of the local fields implies that they are integers, and the functions u and a take 
simpler forms: 



a(J,h) = \h\+S h<0 , u(J,h) = JS(h) 



(15) 



where S(h) = if h = 0, S(h) = Sign(/i) otherwise. In other words the function S(h) is —1 or +1 
depending on the sign of h and it is zero for h = 0. 
We can write the most general V(h) in the form 



V(h) = PrS(h-r) . 



(16) 



Furthermore the symmetry of the J distribution, together with (12), implies that V(h) is symmetric 
(p r = p- r ). The property of the function S(h) implies that what matters is only the sign of h. The 
probabilities p + = p- for having a positive or negative h are obviously given by (1 — Pq)/2, where in our 
notation (16) po is probability of having a zero h. The self consistency condition (12) now becomes a 
closed equation for p , 



[fc/2] /1 X 2g 



q=0 



2q 



(17) 



(where = k\/(q\(q — k)\)) and the other coefficients are given by 



l(k-r)/2] 

Vr=V-r= E C^pg- 9 "- ( ^ 



2q+r 



(18) 



If we specialize for simplicity to a Bethe lattice with fc = 2, the solution is po = 1/3, pi = 2/9, p 2 = 1/9, 
and the ground state energy is E — — 23/18 « —1.278. All these results were obtained in [17]. 

We would like to comment here on the fact that the fields are integers. It was noticed already long 
ago that, even in the simple RS case, the iteration equations (12) admit some solutions which are not 
distributed only on integers, but have a continuous part; in fact a lot of efforts have been devoted to 
find 'the best' among these solutions. Moreover, if a computation is done at finite temperature, where no 
ambiguity is present, and the results are extrapolated at zero temperature, a continuous part is found in 
this RS case. A detailed computation shows that if, working at zero temperature, one starts from fields 
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that are integer plus a small correction, this correction is amplified under the iteration procedure until 
the final distribution is no more concentrated near the integers. In our opinion it is quite likely that this 
instability is a signal that the RS solution is incorrect. A similar effect can be found on the 1RSB solution 
but it is weaker (see appendix A). We believe that whenever one reaches the correct solution (which in 
the present case should be full RSB), this artefact will disappear. Roughly speaking the rational for this 
belief is the following: the fact that a small variation of the field in one point propagates and leads to a 
large effect throughout the whole lattice is precisely the so called "replicon" instability (that would make 
the whole approach inconsistent). The RSB solution was invented just to cure this problem and we know 
that it is very successful in doing this [2]. 



It is well known that the above result is wrong [21-25,9], because the hypothesis of continuity of the 
global ground state when we add new spins or links to the graph is incorrect. 

A mechanism leading to the breaking of this continuity hypothesis, which is not taken into account in 
the RS approximation, is the existence of several local ground states (LGS, not to be confused with GGS). 
By a LGS here we mean a state whose energy cannot be lowered by flipping a finite number of spins. Of 
course such a definition applies only to the N = oo limit. In principle one should define the LGS for a 
finite system as being stable with respect to flipping a number of spins less than f(N), where f(N) is a 
well chosen increasing function of N, diverging at large N. Determining the most appropriate form of / 
is a difficult problem. In its simplest version, the cavity method assumes the existence of a function f(N) 
such that there are many ground states, but does not try to prove it. Controlling this point would allow 
one to turn the cavity into a full mathematical proof, and has been done so far in only a few non trivial 
cases [7,8]). Here we shall not try to provide this kind of rigorous treatment, we just want to show how 
the cavity method works, within its usual assumptions, and check it through the validity of its results. 
Some further comments on the definition and counting of LGS are displayed in appendix C. Although 
the precise definition of LGS is a very subtle issue, we want to underline that there exist at least one 
model, rather closely related to our Bethe lattice spin glass problem, where the present one step RSB 
cavity method can be applied [5] . In this system the LGS can be characterized and enumerated fully and 
the results can be checked versus exact computations done using completely different methods [5,6]. 

In presence of several ground states, the assumption is that there is a one-to-one correspondence among 
the LGS before and after the addition of spins or links (at least for the LGS with low energies). Equiva- 
lently we assume that the perturbation due to the change of the value of a cavity spin propagates (in the 
limit N going to infinity) only to an infinitesimal fraction of the lattice. Therefore it is possible to write 
an iteration procedure for the whole population of LGS with given energy. However it may well be that 
the order of the LGS energies change during the graph operations, and the GGS after iteration is not the 
same LGS as the one before. The problem is to take into account these 'level crossings', which is not done 
in the RS solution of the previous section, and is done in the RSB solutions. Below we shall describe one 
such solution, which is equivalent to what is called in replica language the 1RSB solution. One is forced 
to follow a large population of the LGS of lowest energy, large enough so that one can be sure to obtain 
the GGS when iterating. 

Let us state here the postulates of the cavity method, at the level equivalent to the 1RSB solution in 
the replica language. 

• The cavity spins are uncorrelated within one given LGS. Labelling by a a LGS of a GN,q spin glass, 
its energy E a is given by: 



IV. REPLICA SYMMETRY BREAKING AT THE ONE STEP LEVEL 



A. Basic hypotheses of the cavity method 



q 




(19) 
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The previous equation would be wrong for the GGS because the GGS may correspond to different 
LGS depending on the value of the cavity spins a. This extreme sensitivity of the GGS to the 
variation of a single variable is typical of hard optimization problems. 

• The energies Efi of the LGS of low energy (near to that of the GGS) are assumed to be iid variables 
with a distribution given by a Poisson process of density 



where E re f is a reference energy, which is near to the GGS energy, and fi is a parameter whose 
physical interpretation will be explained in sect. IV D. This hypothesis is compatible with the idea 
that LGS are extremes of the energies, and with the Gumbcl universality class for extremes [26,27]. 

• On a given site i, the local cavity fields in the various states, hf, are iid variables taken from the 
same distribution Pi(h). However the distribution Pi(h) fluctuates from site to site, so that the 
correct order parameter is a functional Q[P (h)] giving the probability, when one picks up a site at 
random to find on this site a cavity field distribution Pi(h) = P(h) [28]. Moreover the cavity fields 
and the LGS energies are not correlated. 

These hypotheses are by no means evident and are likely to be wrong in many models where subtle 
correlations exist among the different cavity field. This more complex situation can appear, for instance, 
in cases where higher order breaking of the replica symmetry is present and it will not be discussed here. 
One should note that, while the 1RSB which we discuss here has a nice interpretation in terms of LGS 
having independent energies (and thus a Gumbel distribution), the higher order RSB solutions involve 
correlated variables and thus describe new universality classes of extremes. In the spin glass case which we 
study here, we expect that an infinite order of RSB will be needed to solve the problem (as is well known 
for the large k case [29,2], which is equivalent to the Sherrington Kirkpatrick (SK) model [30]). The 1RSB 
which we explore is thus an approximation to the problem, which usually produces better results than 
the RS approach. In the limit where k goes to infinity it is know the the GGS energy per spin (divided 
by a normalization factor fc -1 / 2 ) is -.798 in the RS case, -.766 in the 1RSB , to be compared with the 
conjectured correct value -.763. 

It is interesting to notice that the RS case of only one LGS can be obtained in this framework by fixing 
the local distribution to be Pi(h) = S(h — a,), so that all the LGS are automatically equal. On a given 
site i, this distribution is fixed by the single number dj. The various aj's are iid, taken from a distribution 
■p(a) which satisfies exactly the RS recursion relation (12), and the result is \i independent, as it should. 
Alternatively in the limit where fi — > 0, the number of different LGS does no more increase with the 
energy, the gap between the two lowest LGS diverges, and thus level crossings can be neglected. We shall 
see that in this limit we again recover the RS value of the average energy. 



Let us study the effect of the iteration, starting from these hypotheses. When iterating, the new local 
cavity field, in one given LGS labeled by a, is given by the same expression as (11): 



p(E ) = exp(fj,(E - E ref )) 



(20) 



B. Self consistency under iteration 



k 




(21) 



and the energy of the LGS a is globally shifted from Eft to Eg + AEq , where 



k 




(22) 



i=i 
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The functions u and a are given in (10). 

In this case the energy shifts and the local fields on the new spin ao are correlated. Given a site (and 
thus fixing the couplings J,), the pairs (Hq,AEq) are iid, taken from a distribution P (ho, AE ) which 
can be read-off from the iteration equations above: 



P (h 0l AE ) = y II [ p i(tH)dfn] sU -J2 h i)j 5 ( AE o 



^a{J t ,h t )\ (23) 
i=i \ i=i / \ i=i ) 

Let us call Eg ' = Eg + AEq the LGS energy after adding the new spin ao- We first note that Eq' are 
iid, described again by a Poisson process with an exponential density: 

p(E' ) = cxp( M (£ - E ref )) J dh d{AE ) P (h , AE ) cxp(- M A£ ) • (24) 

Therefore the exponential distribution is stable under iteration. The only effect of the iteration is a shift 
of the reference energy from E re f to some new value E' re j . 

As we are concerned with the LGS of lowest energies, we should study the states which have energy 
close to E' re j (alternatively, if we want to follow the population of the M»l LGS with lowest energies, 
we need to keep only the states with the lowest new energy). The joint distribution R (h ,E' ) of the 
local field and the new LGS energy is given by: 

Ra(ho, E' ) oc J dE d{AE ) cxp( M (£ - E ref ))P (h , AE )S{E' -E - AE ) 

cx exp(M£o - Kef))Po(ho) , (25) 

where 

P^ho) - C Jd(AE Q ) Po(ho,AEo)cM-^E ) 

= C J n^^^o-^^Ji^^exp^^a^,^ (26) 

the constant C being fixed in such a way that Po(ho) is a normalized probability distribution. 

The crucial point is the following: for each given LGS the recursion for the probability distribution 
of the h's is the naive one, i.e. the previous one with /j = 0. However if we look at the recursion for 
the probability distribution of the /i's, conditioned to a given value of the LGS energy we find that it 
depends crucially on fi. The probability distribution of the cavity field in a generic LGS is different from 
the probability distribution of the cavity field for a given value of the LGS energy. The two quantities 
may be different because we are looking at the LGS of low energy which are for large N an infinitesimal 
fraction of the total number of local ground states (indeed we shall see later that the total number of local 
ground states increases exponentially with N). 

This distribution Pq of the cavity field on the new site depends on the added site through the choice of 
the various P^s and of the coupling constants Ji. When one averages over these choices, the distribution 
of Po(h) must be equal to the original Q[P(h)): when this self-consistency equation is satisfied, the 
hypotheses of the cavity method on the N spin system are found to be true again in the N + 1 spin system 
obtained after iteration. 



C. Computation of the energy 

In order to compute the GGS energy, we must see the effect of adding a site or adding a link within 
this 1RSB scenario. 
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Site addition: the energy shift during a site addition is computed through the same method as (24), 
the extra term coming from the fact that one optimizes the value of the added spin: 



/fc+i / fe+i fc+i 

Y[ [dhiPi(hi)]exp fj,^2a(J h hi) + fj,\^2u(Ji,h 
i=l \ i=l i=l 



(27) 



Link addition: 



exp ^— [lAE^ 2 ^ = J Y\_[dhiPi(hi)} exp max (/iicti + /12O2 + ^ci^)^ • 



(28) 



Note that one gets back the RS expressions when fi — > 0. Once the distribution <2[P(/i)] of the cavity 
field distributions is known, one can compute the energy shifts AE\ , AP2 which depend on fi, and deduce 
from them the energy function ^(/i) defined as in (7): 



- A£« - ^AP^ . 



One finally finds: 



= Ej 



jf[dQ[P j }AE^[P 1 ...P k+1 ] -^Ej J dQ[P 1 ]dQ[P 2 }AE^[P 1 P 2 ] 



(29) 



(30) 



where c£Q[P] = Q[P]dP denotes the probability distribution of the probability P (the integral is done 
over all the probability distributions P with weight Q[P]). Explicitly, one has: 



= Ej 



fe+i / . fc+i / fe+i fc+i 

ndQ[P,-] log / Yl [dhiPi{hi)]exp UJ2a{Juhi) + l^\J2 u ( J i' h i)\ 

7=1 V"^ i=l V i=l i=l 



fc + 1 

2/x 



Pj 



log Y\ [dh l P l {h i )\ exp ^ max (/ii<7i + /i 2 ct2 + Joyo?) 



(31) 



Notice that all this program can be carried out for any given /1. In order to fix the parameter fx which 
gives the increase rate of the number of LGS, one must compute $ as a function of n and maximize it. 
One justification for that procedure can be to go back to the replica formulation: /j, turns out to be the 
zero temperature limit of m/T, where m is the breakpoint in Parisi's order parameter function at the 
1RSB level [2]. The necessity of maximising over m is a well known feature of the replica method (in the 
limiting case k — > 00 it can be rigorously proven [32] that the value of 3>(/u) is a lower bound to the correct 
result so that it is natural that the preferred value of fi is obtained by maximizing $(/i)), but this does 
not provide a clear physical reason. 

The next section will explain the physical meaning of ^t, and explain why \x must be equal to fi* , chosen 
such that $(/i) is maximum, in order to compute the GGS energy. 

It is also interesting to notice that the whole self-consistency procedure obtained by the iteration 
equation (26) is a variational procedure which can be deduced from the stationarity condition of the 
functional given in (31) with respect to changes of Q[P\. This is shown in appendix B. The existence 
of this variational formulation is crucial in simplifying the computation of all the derivatives with respect 
to the various parameters, because only explicit derivatives must be considered. 
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D. Computing the complexity 



In presence of many LGS, one can be interested in knowing their number. We shall make the basic 
assumption that for large N, the typical number Mn{E) of LGS with a given energy E behaves as 

\og{M N {E)) ~ NY, (J^j . (32) 

The function S(e) is a positive function called the complexity of the problem. In the range of energy 
densities e where S(e) > 0, the log of the number of LGS is supposed to be a selfaveraging function, 
so that for almost all sample (in the large N limit), (1/N) log(A/jv(-E)) is given by S. Technically, 
given a definition of the LGS (see the discussion in app. C), one can thus define the complexity as 
S(e) = Iini7v^oo(l/A0-Ej log(l + ^Vjv(TVe)). In general, for ground states a with a fixed energy density 
e = E a /N, the local cavity fields hf are iid variables taken from the distribution pj- e \h), which now 
depends on e, and fluctuates from site to site. The corresponding order parameter is a functional [P] 
giving the probability, when one picks up a site at random to find on this site a cavity field distribution 
(for states with energy density e): P^\h) = P(h). 

Our goal here is to check the self consistency of these hypotheses under iteration, and to determine the 
'complexity' function S. One expects that S(e) will vanish at some value eo, which gives the GGS energy 
density, and the analysis of the previous section applies for LGS having energy close to Neq (plus terms 
of order one). In this context the value of U can be found by looking for the solution of the equation 

£(£/) - . (33) 

Let us first study the effect of the iteration. The number of LGS at energy E after iteration is given by 

Af N+1 (E) = J P (h ,AE)dh dAEexp(^Nx(^^yj . (34) 

We need to compute the distribution of local cavity fields Pg e \h) at a fixed GS energy density E/N = e. 
Expanding to first order in the small shift AE/N in (34), we obtain: 

P^\h) = C j Po(h ,AE)dAEcxp(-nAE) 

r k / k \ / k \ 

= C j \{[ p ^\ h i) dh ] ^ Uo-^w(Ji,/ii)JexpU^a(J i ,/i i )J , (35) 



z—l \ i—1 / \ i—1 



where 



„ = — . (36) 

Notice that we get back exactly the same expression as in the previous section (see(26)), but now /i has 
a well defined meaning: it is the derivative of the complexity with respect to the energy density e. When 
one varies e, the value of [i changes. The whole formalism of the previous section can be used for any \x. 
Its result will give the distribution of cavity fields for the states a which have energy density e, which is 
related to \x through (36). The functional probability distribution found in this way is Q[P^(h)]. 

In order to compute the complexity function £(e), we must see the effect of adding 2 sites or adding 
k + 1 links to a GN,2k+2 graph within this 1RSB scenario. Let us call S 2 fc+2(e) the complexity function of 
the £/jv,2fc+2 graph from which we start. 

Site addition: By adding one site, we go to a £/jv+i,fc+i graph with complexity £fc + i(e). To compute 
this, we notice that when one site is added and the corresponding spin is optimised, the energy of the 
LGS is shifted by a value AE, and the corresponding probability distribution P sit e(AE) is: 
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„ fe+1 / fe+1 fe+1 

P site {AE) = / 1] i dh i P i( h i)] S [ AE + £ fl ( J - ^) + I S M ( ^' M 
»=1 \ i=l i=l 



(37) 



After the site addition, the new complexity Sfc + i(e) is: 



exp 



(7V+l)S fc+1 



7V + 1 



TVS 



E-AE\ 



= J P si te{AE)dAE exp ^2^+2 . 
= exp [7V£ 2fe +2 (£?)] /" P S4te (A£;)dA£;exp [— /xAE 1 ] 



(38) 



LmA; addition: By adding one link, we go to a (?jv,2fc graph with complexity S2fe(e). The probability 
distribution for the corresponding energy shift is: 



P Hnk (AE) = / ]J [dhiPi{hi)] s(AE+ max {h^ + h 2 a 2 + Ja^) 



(39) 



After the link addition, the new complexity Y,i k {e) is: 



exp 



AT ( — 

N 



P link (AE)dAE exp 



NY 



2k+2 



E — AE\ 



N 



■ 



= exp [NY 2k +2 (E)] P link (AE)dAEexp[-tiAE] . 



(40) 



Going from a N site graph to a N + 2 site graph: As before, we need to add two sites and take away 
k + 1 links. When performing two times the site addition, we go to a graph Qn+2 where the number of 
GS is 



exp 



(N + 2)Y 



E 



N + 2 



exp 



NY 



exp 



2Y 



S' 



(41) 



while performing k + 1 times the link addition leads to a graph Qn_ where the number of LGS is 
exp (NY(E/N)). Adding up the effect of the link additions and the site additions, one obtains: 



E(e) - eE'(e) = £jlog P site (AE)dAE exp {-^AE^j 

-^__£/log (^J Pu n h(AE)dAE exp (—fiAE) 



(42) 



where the average Ej also implies an averaging over the choices of Pi(hi) appearing in P S it e and Pu n k 
(the functions Pi have to be taken from the functional distribution Q[P(h)]). 

Comparing to the expression for the energy density derived previously (31), one gets simply: 



£(e) — (41 = — , where \i = £'(e) ■ 



(43) 



So the knowledge of the function 3>(/u) allows to reconstruct the complexity function £(e) through a 
Legendre transform [31]. The usual relations for such a transform, 



d\i 



d$ _ E(e) _ e-$Qi) 
d\i 



/i 



(44) 



show that the condition of maximisation of is equivalent to having £ = 0. This proves that the 

GGS energy density is found by maximising $(/•*) with respect to \i. It also gives the practical way of 
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deducing the complexity from the knowledge of Because of the structure of (43), we call $(/x) the 

zero temperature free energy of the problem. In fact the previous equations could also be written as 



exp(-iV^$(^)) ~ J de exp (-Nefi + NE(e)) ~ cxp {-fiE a 



(45) 



where a labels the LGS and E a is the total energy of the LGS. In other words $(/•*) is the free energy 
(at a temperature l//z) of a system where the sum is done only on the LGS and not over all the spin 
configuration (as in the case of the usual free energy). One could also apply the same techniques used at 
finite temperature [9] to rederive the previous expression for $(/i) and S(/i) in a slightly different way. 

Let us give here for completeness the full expressions used in the computation of the complexity. Once 
one has solved the iteration equations at a given /x, and obtained the functional probability distribution 
Q[P], one can deduce from (31). The energy density e can then be obtained as: 



e = -Ej 



I dQ[Pj] - — 

j=i I n, fe =i [dhiPi(hi)] exp a(Ji, hi) + \ Ylt=l u(J h /ij)l) 



dQ[P{\dQ[P 2 ^ 



I nLi [dhjPi(hi)} D M (max CTl , CT2 (hicn + h 2 a 2 + Jgigg)) 
/IlLi [^i^(^)] exp (/jmax ffli(72 (h 1 a 1 + h 2 <J 2 + Jo x o 2 )) 



(46) 



where we have defined the function D fl (x) — xe^ x . The previous equations can be rewritten with an 
evident meaning of the symbols as: 



e = -Ej 



* tt dQlp , J n^i 1 [^^(fei)] A^ 1 eM-H^) 
M / [^^(^)] exp (-mA^ 1 ) 



+ 



fc + 1 



f dQ\Pi]dQ[Pi 



J IlLi [g^Q] Ai? 2 exp(^A£ 2 ) 
/n-=i[^^(^)]exp(-MAi; 2 ) 



Finally the complexity is 



E(e) = Me-<&) , 



(47) 



(48) 



where $ is given in (31) and e is given in (46). 

The smart reader may cast some doubts on the consistency of the whole approach: our first hypothesis 
was the existence of a one-to-one correspondence between the ground states when increasing N by two 
units (and therefore the number of ground states should no depend on N) and from this hypothesis we 
arrive to the conclusion that the number of ground states increase with N as exp(iVX(e)). We believe 
that the hypothesis of one-to-one correspondence of the LGS is valid only in a low energy region, where 
the computation that we have presented is correct, and it should be modified in the region where S(e) is 
near to its maximum. 



E. Factorized case 



A particularly simple case is when we assume that the distribution Pi{h) are i independent (i.e. the 
Q[P(h)] is a functional 5 function). This case, which was first studied in [33], and developed for the Bethc 
lattice spin glass in [34] , is named the 'factorized case' because of the special pattern of RSB to which it 
leads. It is simple because the order parameter is a single function P(h) (fixed from the self-consistency 
relation (26) by imposing Pq(H) = Pi(h) = P 2 (h) = ... = Pk(hj), and the RS equation arc only slightly 
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modified. However one should note that, in general, one may expect a Pi(h) which fluctuates: this is 
obviously the case whenever the connectivity fluctuates, but this may also happen in the case of the fixed 
connectivity random graphs which we study here. Some special models where the factorized Ansatz gives 
an exact solution have been studied recently [35,36]. 



F. Application to the ±J model 



1. Factorized case 



Our first task is to compute the distribution Q[P(h)]. We will do it here first in the simple factorized 
case where Pi(h) does not depend on the site (so that Q[P(h)] is a functional S). The distribution 
Pi(h) = P(h) still has the form of a sum of delta peaks on the integers P(h) = YlrPr^Q 1 ~ r )- This 
factorized solution can be stable only if P(h) is symmetric (p r = p~ r )- The equations for the weights of 
the 5 peaks Po,Pi, ■■■,Pk, taking into account the free energy shift, are: 



^ E - E $ (r-^2S(hi)\p hl ...p hk expln 



-k hi i — — k \ i—l 



X](N +<^,o) 



(49) 



(the function S has already been defined as S(h) = if h = 0, S(h) = Sign(h) otherwise). The quantity 
A is a normalisation constant fixed by the condition 

k 

l=p + 2^p r (50) 

r=l 

One can notice the similarity of (49) with the RS solution (16). With respect to this RS solution, the 
self consistency equations are only modified by the rewcighting term in exp(/x...). However the physical 
interpretation of P(h) studied here and the V(h) of the RS solution are totally different. The present 
P(h) gives, for one site i, the probability that in a LGS a chosen at random, with energy density e fixed 
by the value of /x, the field hf is equal to h. In the RS case, there is only one LGS, and V(K) governs the 
fluctuation of hi from site to site. 

In the case k = 2, one obtains, for any fi, an algebraic solution: 

Po = (24 + Se* - (8 + e - )v /8T^)/(4(e* - if) , Pl = , P2 = (51) 

where 

= p (3p a - 2) 
e** - 4p - 2p e^ 

After some algebra one finds that the energy shifts are given by: 

cxp (- M A£«) = [pl + 6(p! + P2 en] + ^ +P 2 e M ) + Hpi +P2) 3 ] 

+ e 5 " [3po(pi + P2 en 2 ] + [( Pl + p 2 e»f] (53) 
cxp (-iiAS< 2 )) = e^ 1 ( [2 Pl e^ + 2p 2 e 2 ^] [p 2 e 2 ^ + Vl e^ + p + Pl e~^ + p 2 ] + Po [2p 2 e 2f * + 2 Pl e t " + p ] ) (54) 

Using the values of Po,Pi,p 2 in (51), we obtain from(31) the zero T free energy $(/i) which is plotted in 
fig. 4. This quantity has a maximum at /j, ~ .4174, where the GGS energy is equal to E = —1.27231. All 
these results using the factorized Ansatz were derived previously with the replica approach in [34] . 
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Bethe lattice spin glass 

k=2, T=0 



-1.276 



-1.278 



-1.28 




FIG. 4. The zero T free energy per site &(fJ,) as a function of [i — f3m for k — 2, T — 0. Shown are the one 
step solution in the factorized case (dotted) and the correct 1RSB solution (full) computed by 10 4 iterations of a 
population of 10 3 (1RSB) or 10 4 (factorized) local probability distributions. In the 1RSB solution, the full line is a 
spline interpolation through the data-points. There is a clear evidence for a non-factorized solution, although the 
effect on the energy is small. 



2. The full 1RSB solution 

Let us now go beyond the factorized approximation. On a given site j the probability distribution of 
the cavity field is 



P(h\P J )= E Pl 5 (h-r) . 



(55) 



r— — k 



It is parametrized by a vector of weights, p* — (p J _ k , ■■•,pl) which can fluctuate from one site j to the 
next. Because we work at zero temperature and the fields take integer values, the probability depends on 
a finite number (2k) of parameters, and the full order parameter is not a functional, but a function R(p) 
of the vector of weights p = (p_k, ...,Pk), which is given in the limit of large N by: 



IP 

,r= — k 



Pr - Pr 



(56) 



Let us perform one iteration, by adding a spin a in the cavity, connecting it to the k cavity sites 
ji, jk, and optimizing the values of cr^, <7j k . The distribution of the cavity field on site again takes 
the form (55), with: 



hi — — k hi i — — k 



E(M + */w>) 



(57) 
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where A is a site-dependent normalisation constant, fixed by J2 r Pr = 1- 
The energy shifts are given by (27) and (28), and are also site dependent. 

The iteration (57) offers a way to obtain the order parameter R{p) by a method of population dynamics 
[9] . The method amounts to following a population of J\f vectors p 1 , . . . , p^ . Each iteration of the dynamics 
corresponds precisely to the iteration of the cavity method: one picks up k vectors p 11 , ■■■ 1 p ,k at random 
in the population, one computes the new vector p° according to (57), and substitutes the new factor p° 
in the population, in the place of a randomly chosen vector p 1 . This stochastic process yields, after some 
transient regime, a population whose distribution is stationary, and the probability distribution of p inside 
this population is nothing but the R(p) order parameter. The energy shifts AEW and AE^ obtained 
when adding one site or one link are computed as before, and they are then averaged over many iterations. 
This allows to compute, for any fj,, the zero T free energy $(/i) using (29), which is shown in fig. 4. It 
has a maximum at a value /i ~ .7, and predicts a GGS energy density U ~ —1.2717. 

One should notice that in this problem the quantitative effect of RSB on the GGS energy density are 
rather small. The full 1RSB result U ~ -1.2717 differs from the RS result U ~ -1.2777 by 5.HT 3 , and 
the factorized solution gives a very good approximation U ~ —1.2723, precise at 5.10~ 4 . Therefore one 
can expect that the quantitative effects of higher order RSB on the GGS energy will be tiny. 

Distribution of c_0 

X= .4, .8, 1.2 

20 



15 



a. 10 



5 



"0 0.5 1 1.5 

c_0 

FIG. 5. Probability distribution of po, obtained after evolving a population of M = 10 5 sites. Plotted are the 
cases [i = A (black), /i = .8 (grey) and /i = 1.2 (light grey). Notice the big effect of non-factorization. The best 
factorized solution, with [s, = .4174, would give a 5 peak at po = .3353. The RS solution would give a 5 peak at 
po = 1/3. 

However, the qualitative consequences of RSB are clearly visible on the fact that the probability dis- 
tribution of cavity fields is site dependent. This is exemplified by fig. 5, which gives the site to site 
fluctuations P(po) — J2i $ (Po ~ Po) 01 the probability of having a zero cavity field. We have also 

checked that, while the individual cavity field distributions Pj{p) are not symmetric under field reversal 
(i.e. Pj(p r ) ^ Pj(p- r )), the full order parameter is statistically symmetric (i.e. the site to site fluctuations 
of p r are identical to those of p~ r )- 

Using the previous results one can compute the complexity function S(e). In fig. 6 we show the results 
in the region where the complexity is positive. In order to obtain these results we only need the function 
$(^i) in the region to the left of its maximum, where d$>/dfi > 0. 
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FIG. 6. The complexity E as function of e, for the k — 2 spin glass on the Bethe lattice. The full curve is the 
result of the full 1RSB solution, the dotted curve is the result of the factorized approximation. 

The complexity is rather similar in the factorized method and in the true solution, apart from some 
small variation of the ground state energy. However it shows a somewhat unusual form which we wish to 
comment. One sees two branches. The right branch is concave and goes from e = U, the ground state 
energy where the complexity vanishes, to e = em, the maximal energy beyond which one does not find 
any local ground state, which corresponds to a value \i — [iu- It is obtained for fi 6 [fJ-M, M*L where jji* is 
the point where $(^) reaches its maximum, corresponding to the GGS energy U. The second branch is 
convex, and interpolates between the RS solution (obtained at = 0) and the maximal complexity point 
(obtained at (i — [Am)- This second branch does not seem to have a direct physical interpretation and in 
this context can be simply ignored. On the other hand it must be present insofar as the fj, — > limit of 
our RSB solution gives back the RS solution. Clearly a better understanding of this second branch would 
be welcome. 

It is curious that this type of complexity curve has not been discussed in the literature so far, to our 
knowledge. In the rest of this section we want to present a short comment on some apparent discrepancy 
between our results and some widely used results on the SK model [30] . In the SK model which corresponds 
to the k — > oo limit of our problem, the states can be defined at any temperature as solutions of TAP 
equations [37,2]. Bray and Moore [38] have computed the number of such solutions, and they have deduced 
that in the zero temperature limit, the corresponding complexity becomes equal to the complexity of one 
spin flip stable (1SF) states, which has been computed in [38,39]. In fig. 7 we show the complexity of 1SF 
states, and also the complexity at the 1RSB level computed through the use of the Legendre transform 
of the free energy as in (43). This 1RSB result is indeed very different, qualitatively and quantitatively, 
from the complexity of 1SF states, and also different from the general shape found by Bray and Moore at 
finite temperatures. 

It seems to us that this difference can be explained by two arguments: - The 1SF configurations are 
generically not stable to several spin flips (in contradiction to what is claimed in [40]) and in particular 
a change on the cavity fields may propagate through the whole system - The free energy functions of 
[38] admit also other new saddle points which have not yet been considered. Clearly a full discussion of 
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these points goes much beyond the scope of the present paper; much more work is needed in order to 
understand the relationship between TAP states, the q-spin flip stable states, and the Legendre transform 
construction in spin glasses [41]. 




FIG. 7. The complexity E as function of e, for the Sherrington Kirkpatrick model The top curve is the complexity 
of configurations stable to one spin flip, the bottom curve is the result of the 1RSB solution. The inset shows the 
details of the curves near to the ground state energy. 



V. CONCLUSION 

With respect to our previous work [9] on the cavity method for the Bethc lattice spin glass, the fact 
of working directly at zero temperature allows to simplify the discussion of the cavity method in several 
aspects . On the one hand, one can discuss the physics directly in terms of ground states. The physics 
of RSB comes into play when there exist many LGS and their energies may cross when one adds a new 
spin. At a more technical level, the cavity fields are integers, and it is thus much simpler to parametrize 
their probability distributions. This allows in some cases to get analytic solutions, but also when one has 
to resort to the numerical solution of the cavity equations using the population dynamics, this aspects 
simplifies a lot the procedure: one can follow a population of the local distributions Pi(h), because each of 
them is easily parametrized, while in the finite T approach one must represent each Pi(h) by a population 
of M. fields. Computationally, this zero T approach is thus much more efficient. This is very interesting 
for discussing optimization problems, and in fact it has already allowed for a full solution of the Ksat 
problem [4]. We expect that it can have many other applications in this context. 



1 We warn the maybe puzzled reader that the form of the free energy functional we use is different from that of 
our previous work [9] . There are many equivalent free energy functionals that one can use that coincide when the 
recursion equations are satisfied and are variational. The one used in this paper has been selected because of the 
simplicity of the derivation (incidentally it leads to smaller statistical errors when doing numerical studies). 
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APPENDIX A: THE T -> LIMIT AND THE RSB LEVEL 

If we study the thermodynamics of the model at finite temperature, we can use a very similar approach 
where the free energy of valleys is used instead of the energy of the configuration. A similar cavity method 
can be developed at all temperatures, as was done in [9]. In general one would expect that the finite free 
energy density computed in this way be continuous at T = 0, which means that one should get back the 
results of the present paper by using the T — > limit of the finite T computations. 

Strictly speaking this does not happens for the model with J = ±1. The reason is the following. Strictly 
at T = if the local fields have integer values when we start the iteration, they are then always integers. 
On the contrary, starting from the same initial condition at T ^ 0, after a few iterations the local fields 
are integer plus corrections of order T. However it is possible (and this is what happens in the RS and 
in the 1RSB cases) that the coefficient of the corrections proportional to T increases exponentially with 
the iteration number so that, after a number of iterations which is proportional to | lnT|, one obtains a 
distribution which is no more concentrated near the integers. 

In our opinion it is quite likely that this instability is an artefact of not using the full RSB scheme and 
it should disappear when more and more precise computations, with higher levels of RSB, will be done. 
In order to substantiate this point we have computed the distribution of the cavity fields in the J = ±1 
case for k — 2 at very small T (i.e. T = 0.01) both in the RS case and in the 1RSB case. The results are 
shown in fig. 8. It is evident that in the 1RSB case the distribution is much more concentrated on the 
integers. 



x x xxx 



FIG. 8. Crosses give the distribution of the cavity fields, V(h), computed at temperature T — .01 in the RS 
approximation. Dots give the site average distribution of the cavity fields, J dQ[P]P(h), at the same temperature, 
in the 1RSB approximation. Clearly the distribution becomes more peaked onto integers when one increases the 
level of RSB. 



APPENDIX B: VARIATIONAL FORMULATION 



It is interesting to notice that all the equations of stability under iteration of the cavity procedure, 
jiving the probability distributions of local fields, can be obtained from a variational principle. 
In the replica symmetric case, let us define, for a generic probability distribution R(h), the functional 



(58) 
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where and <f>( 2 ) are given by: 



and 



{T [dfl(/n)] min - V J.aoCTi - V] /i^ 

i=i v s ^ 

<S>^[R} = E,, ( dR(h) dR(ti) min(- Jaa' -ha- h'a') 
J CT - cr ' 



(59) 



(60) 



where dP(h) = P(h)dh. One can show, following a method similar to the one given in [9], that the 
stationarity equation of this functional 



8&[R] 
SR(h) 







(61) 



coincides with the equation (12) giving the field distribution P(h). Furthermore, on this solution, one can 
use the stationarity equation in order to derive: 



$ (1) [P] = AE W [P] 
<f>^[P] = AE^[P] 

where AE^,AE^ are given in cq. (13,14). This shows that, on the solution, 

*[P] = U 



(62) 



(63) 



The variational formulation also exists in the 1RSB case. In this case, we need to introduce a functional 
$[Q[P(/i)]] (a somewhat complicated object). We introduce first the two expressions for $^[2], 3>rsi>[2] : 

fe+i 



*W[Q] = -±Ej f f[(dQ[m 
V J i=i 
fc+i 

J Jl idhiPiihi^exp 



fc+1 



fc+1 



fi min — \ Ji&o&i — } hiOi 

CT0,O-l,...,CTfc + l \ ' ' 



i=l 



and 



#^ 6 [e] = ~Ej J dQ[P] rfQ[P']log (^J dhP(h)dh'P'(h')exp 



-jj, min(— Jaa' — ha — h'a') 



and then construct as before: 



*rs„[Q] = KlliQ] 



(i) [Q] _ 



(64) 



, (65) 



(66) 



We must now compute the functional derivative with respect to Q. We first notice that Q must be a 
normalized distribution so that 



/ dQ[P] 



= 1 



(67) 



This constraint will be enforced using a Lagrange multiplier A. Let us consider the functional derivative 
of <fr rs fc[Q] with respect to Q[P], evaluated on an arbitrary function P(h) = P*(h). We find for the first 
piece: 
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E, 



n (dQiPi. 



SQ[P] /i 

log< / dh k+ iP*[hk + i]Y[(dhiPi(hi)) exp 



i=l 



fe+1 



fe+1 



-/i min - JjeroCi - h i o l 
0-0,0-1, .■■)0 , fc+i \ r — , — 

\ »=1 2=1 



(68) 



and for the second one: 



6Q[P] 
Finally, the equation 



-Ej J dQ[P']\og[ I dhP*(h)dh'P'(h')exp 



-/i min (—Jaa' — ha — h'a') 



6*rM _ 6*% b [Q] k + 16*?] b [Q] 
5Q[P] ' SQ[P] 2 SQ[P] 



= A 



(69) 



(70) 



should be true, with an appropriate choice of the Lagrange multiplier A, for any P* . 
In the first piece we can use: 



f[{dhiPi(hi))exp 



i=i 



J HidhiPihi^exp 



/ k k 

H min \ -y^a(Ji,hi) - a a y^u(Ji,hi) - J k+1 a <j k+1 - h k+1 a k+1 



(fe+1 fe+1 
i=i i=i 



i=l 



i=l 



(71) 



Let us then define the probability distribution Po(^o) through: 



J J{{dhiPi{h, 



))exp 



5 (ho -Y^uiJuhi)^ = C[{P}]P (h ) 



(72) 



where C[{P}] is a functional of the Pi with i G {1, ...,&}. As Q[P] satisfies the 1RSB self-consistency 
equation, we know that the distribution Po(ho) defined in (72) is generated with a probability Q[-Po]- 
Therefore we get, on the 1RSB self-consistent-under-iteration solution for Q[P]: 



6*% b [Q] k+l 
SQ[P] ~ 

exp 
k+l 



Ej j dQ[P ] log (J dh P (h )dh k+1 P*(h k+1 ) 



-/j, min (-Jfe+icroCTfe+i - h a - h k+1 <r k+ i) 

Oo,Ofc+l 



Ej ftl(dQ[Pi\)HC[{P}}) 



(73) 



i=i 



Clearly this is equal to — (k + l)/2 times the derivative of for any P*, up to some constant that 
compensates with the Lagrange multiplier A. The curious reader may find interesting to know that 



A = 



_ 6Q rab [Q] _ kjk + 1) 



SQ[P] 



Ej J (dQ[P]) log (J (dh P(h)) exp [ M a(J, h)]^j (74) 

Notice that the expression (46) for the internal energy can be directly derived using the relation 
d(n$(fj,))/dfi = e. Indeed 
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where the derivative ^ act only on the explicit dependence on \i. The second term in the previous 
equation is zero when Q satisfies the equilibrium condition. If we compute the derivative of eq. (42) wc 
get the result contained in equation (46). It is interesting to notice that all the equations of stability 
under iteration of the cavity procedure, giving the probability distributions of local fields, can be obtained 
from a variational principle. Moreover the fact that the free energy we use is a variational one is crucial 
in simplifying the computation of all the derivatives with respect to the various parameters, because only 
explicit derivatives must be considered. 



APPENDIX C: MISCELLANEOUS COMMENTS ON THE DEFINITION OF THE STATES 

In this appendix we give some further comments on the definition of the LGS and of the complexity. 
The subject is rather delicate from the mathematical point of view and if one is not precise it is easy to 
make wrong statements and to find contradictions. Our aim here is just to point out some of the subtleties 
which one should take into account. 

In the definition of LGS we have asked that the configuration should be stable with respect to k spin 
flips with the number k going to infinity with N in some unprecised way. We could start by defining a 
LGS of order k as a configuration that is stable with respect to k spin flips. In this way one could define 
the complexities Efc(A^) as (1/N) log(Number of /c-spin-flips-stable configurations). The complexity of 
LGS could be defined as 

S a = lim lim S fe (iV) . (76) 

k — >oo N — >oo 

An alternative natural definition is to define LGS as stable to changing an infinitesimal fraction of all 
spins: 

S b = lim lim Y, eN (N) . (77) 

e— »0 N—+oc 

The question of the equivalence among various possible definitions of S, and in particular whether S a = E&, 
is a well posed mathematical problem and may have a non trivial answer. 

One case in which one encounters problems when studying the large k, large N limit is the SK model. 
Although it is quite possible that these problems are an artefact of the infinite number of neighbours in 
the SK model and they may be not present on the Bcthc lattice, let us mention them here briefly. In 
the SK model one can compute [38,39] the complexity of one spin stable configurations, lirn/v— >oo Si(iV). 
A detailed computation shows that (at least at not too low energies) the probability distribution of the 
local fields h in these states P(h) goes to a constant when h goes to zero. It is easy to deduce that with 
probability one these states are not 2-spins stable and therefore they do not correspond to LGS, with 
any reasonable definition. This argument might seem to imply that limjv^oc ^(N) < limjv^oc Ei(iV). 
However this is not true: we can count the limit for large N of the complexity, £(£), for the "5-stable 
configurations" such that 

<Ti -hkOk > 5 . (78) 

k 

Irrespectively of the precise value of 5, a simple computation shows that is continuous at S = 0, 

while S(0) = limAr^oo Ei(iV). On the other hand testable configurations are also stable for k spin flips 
(at least when k <C 5\/N). This argument shows that for the SK model limjv^oo Sfe(AT) is k independent. 
These configurations are likely not to be LGS if we ask for configurations that are stable with respect to k 
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spin flips with k oc N 1 ' 2 but they should be fc-spin-flips-stable if k oc A^ 7 with 7 < 1/2. It appears rather 
likely that there will be a change of behaviour in the complexity when k <~ >/~N. Further and detailed 
investigations are needed to clarify this point. 

After this digression on the SK model, let us come back to the computation of the LGS complexity 
that we have done in this paper. As we have already stressed, we do not use directly any of the previous 
definitions based on Efc(AT). We have just argued that a LGS must correspond to a local solution of the 
cavity equations and we have counted the number of these solutions in the infinite N limit. This procedure 
does not give a clue on the finite N effects, and therefore on the definition of LGS on one given (finite N) 
sample. 

One possibility could be to write directly these equations on a finite lattice (these arc nothing but TAP 
equations [37]) and to associate to each solution of these equation a LGS. However it is well known that 
in general global solutions of TAP equations for one given sample are rather rare [42] : the local analysis 
of the solution of the equations near to a given site of the lattice that we perform docs not guarantee 
to provide a global solution to TAP equations. Probably the best one can hope is the following. We 
could define a quasi-solution of order a of TAP equations as a configuration of spins such that a fraction 
1 — a of all TAP equations are satisfied and a fraction a of TAP equations are not satisfied. Our N — > 00 
analysis considers on the same footing the true solutions of all TAP equations or the quasi-solutions where 
a vanishing fraction (for A" — > 00) of the equations is not satisfied. So one could conjecture that the LGS 
correspond to quasi-solutions of order a, in the limit where a — > 0. Notice that the a — > and A" — > 00 
limits may not commute and therefore one should be rather careful before making any precise statement 
on the number of TAP solutions. 

In order to illustrate the previous point let us consider a simple example, a one dimensional chain, which 
is a particular example of a Bcthe lattice with k = 1. Let us assume that the system is antiferromagnetic 
(i.c J(i, i + 1) = — 1) and that periodic boundary conditions are used. 

The TAP equations are given in terms of the local cavity fields: 

h^(i) = -h^(i-l) ; h^(i) = -h^(i + 1) (79) 

where we have used the obvious notation h*~(i) = h(i\i + 1) , hr*{i) = h(i\i — 1). If N is even we have 
two degenerate GGS, i.e. 

a(i) = (-I) 1 and a(i) = (-l) i+1 (80) 

On the contrary if N is odd we have A" degenerate GGS with one defect in k, i.e. 

a{i) = (-If for i < k ; a(i) = (-l) l+1 for i > k (81) 

If we look at the TAP equations we see that for Af even there are two solutions (corresponding to each of 
the two GGS) 

h 4 -{i) = h- t (i) = ±(-l) i (82) 

On the contrary there are no solutions of the TAP equations for odd A^ as an effect of the periodic 
boundary conditions. Obviously there are A^ quasi solutions of order 1, that luckily correspond to the A^ 
GGS. 
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